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(54) PROCESSOR AND METHOD FOR CORRECTING IMAGE DISTORTION AND MEDIUM WITH PROGRAM 
PERFORMING IMAGE DISTORTION CORRECTION PROCESSING STORED THEREIN 

(57)Abstract: 

PROBLEM TO BE SOLVED: To provide a device which corrects the 
distortion of an image fetched by a video camera, especially image 
distortion caused by an image pickup lens. 

SOLUTION: This processor comprises a capture unit 12 fetching an 
image from a camera 1 1 , local memories 1 7 and 1 8 to which the 
image fetched by the capture unit 1 2 is transferred, a processor 1 9 
which accesses the local memories and performs image distortion p jjijt? [ 
correction processing of the image transferred to the local p ---- -- ]. | 

memories, and DMAs 14 and 15 which perform DMA transfer of the 
image onto the local memories according to a DMA transfer 
instruction string which is preliminarily prepared to convert the 
address of the image that is not subjected to distortion correction j - 
processing yet. | , 
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B^-SrlfrlEf^gBpf ±}c:DMAte)i-r5DMA§|Si:, 
sKj^^ix^rtgU^^y 

mIIE?g^^lIE*Q!a|fj(0|fll5H^OT K i^^ ^^^"t^ fc 20 
il^5rmIIEl*3a5^ ^ y ±{CDMAg5^i-5 DMA3.=: 5, 

DMAteji^^<D3?iJ{CtJeoT?^Iii^?lrMIEF^Sl5^^-y{C 30 

^nfcDMA^ol^Oiy— >{r>';;^SrsExeLf::X'f >^ y 
^ i:: J: ^5 JElf) $ 5 ^ <!: ^ 1- 5 W*3i 1 ;t V > L 3 

-©y ^ y {cii^Sr^^tptC'teo;^ ^ y ©rt^^*aa-r 
Ma^S. 

MiEfea^=fTV\ ^^ttiE^tJia^OK^/ h^iiffl(DK-y 

^fffSErtSlS^ * y »c»#5itf r ^#^i:-r:5ft*il 1 
V ^ L 5 ©I ^-f ti;?)^ 1 id lEicWS^SI^ffiiE^&ageo 

E-r 5 iii^2^«I^a;^fetc*5V ^T. 
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2 

^■y (d*5illi-5^x-7 7'i:. 

itriES^MiEMami©i]fEM^<DT K^;^^^^i-5fc 

fef^fife $ tLTt D M Atej|^^^©?iJ}c L;/t;i^ oT^ 
m^^MP^U^ * y ±lCDMAe5^1-5:^x y -ft . 

^^1-5 r i =^#tlJ:ti-SB^il^MiEMa;^&o 
[11*118] WM^m^hm'^i'^'O'^hti^^t. 

fuEl^gB^ ^ y ^'ir^ LT^I^gU^ * y iC^gJS^ti 
fcluEH^^Si^MlEMa ^=fT 9 1?^^ <!; . 
BulES^ffiiEtoaiuoSuffiH^OT V\^:^i:mmir^tc 
ii!)t-^*f^J5fe$n:fcDMAte^lli^^©?iJ(- L/c;55oT^ 
iii^$rlflErt§l57« ^ y ±fc DM Ateit1-<5#^ i: . 

[0 0 0 1] 

[0 0 0 2] 

^SSLt \.XWGAmm^^m^f\.. O O Yy 

^6 4 0 V(r>'7V\i vi^:^t\^xm^^fy,x\i^ 

[0 0 0 3] ;!7^7*^bffii9 5Z.Ayfc:H^fi^vX 

OS^^jJifir<tl9s a^gfi^JJieB^^O^bJt-^SirS^SrJt 

-eiiS^tr i 19 ^t:? 5 t ''j^ o T L * 5 „ 
[0 0 0 4] ±EOj:9/i;&;<7»C<t!9#feti7tB^* 
|+^^iCj;i9®^ISIIS^^^T5T^u=i'y Kit-^ 

^m-f^ z.t\cj:<o mmK!Si^m^£^m^:mbLxi&m-r 



3 

I 0 0 0 5 1 mm<DW)%-<if h/v-^^^twi-s^. 

[000 6] 

mmim»:hi: 5 ti-s^si mmw^m^-r^^ lo 

[0 0 0 7] Ld^L, *^7U>X{cEHLTjii^;i^'M 

[00 0 8] roM^os^^ffljEu ^ta-rsggi: 

D 7" D ir J/ f - T* tt^a jS3S{t:-r 7t i6 =3r y ^> :i ^ 

[0009] imm^A-cmf-. ii^<©2 

[00 1 0] 

t ?r#f!t-r5M^S^Ml*{La£«^a«i-5„ 

[0 0 1 11 imm-cx^^bt^ wmm:.^Ji--k^x.^ 

gg{c i "9 ® M^lc^^MlEMa^^ife-r r i: 

vmi^■^^hf^^. 50 
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[00 12] syt. ^©ispjfi. a^^gtij:»9a^$ 

ilCDMA^il^-rSDMA^.;:!.;/ hi:, S^MlE 
[0 0 13] ;$:^PJic:J:5i:. m^^^iQ^^^tm^^ 

[0 0 14] ^/c. :i(D^PJ{±. iffiODMAgP^i^. ^ 

^^fiiE«ia^<^W^<OT K^;^©l£lt;;J5 U =Tfc/£?) j; 

5 {-S^MlEMaitFc^T K i:mm-t^ J: 5 (-^ fef^ 
^ $ tlfcDM A^iil^#^(D?iJ(CtJ§ o TH^ f^gP7< * y 

Kum-t^ ^ ^ ^^ttt-rsw^s^ttiE^iia^asrs 

[0 0 15] S/c. rro^Bjfls ±teDMAgP;ii5, i^gg 

[00 16] s/c. zommn. ^moj^u/^'ji^^p 
(D/^\) (DF«j^^^ai-5iii^s^MiEA&agg^s^ 

[0 0 17] */c. wCD^|^{±. JilE©>^p-iryi^;ei5. 

t i-5H^s^Mma^g?^ffi#t-r 5„ 
[0 0 18] *fc. z<D^m\i. m^mmxr)m7i<A. 

/cli^^(DS^<^ffiIE■f?)li^i■s^ffiiEfea^ffi^c*3v^ 

ii^3ggd^b®^^ffi!3iZ;tp;^xs/7°,!:. 

U {itei^$ti/c:|frEil^©S^MlE^a<^tT5^x5/:/ 
s^ME^atfroM^wT Kw;^5r'^jfei-5fc«)(c 
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[00 19] ^tc. :i(D^mt±. »^gg/6=>P>M^^5f 
[0020] 10 

mm<Dmmmm] mux ^(D^m<D-mmmm\z 

DMA(A)14. DMA (B) 15, ^^^^-/i^ 
^ 1 et^^m^tl^o DMA(A) 1 4*Jj;t;«DMA 
(B) 1 Sfil^aJ^^y , fip*,D-*;V^^ y (A) 1 
7iiJ^nu—^;l^/^]) (B) 1 8 t'^tl-etlg?^^ 

2 3ioJ;tJ«ROM2 4:JS^$n5„ 
[00 2 1 ] n-:*;V^^!J (A) 1 T^oit^n-^yV 
(B) 1 Sli^niryf-l 9}C^M$n5„ 
T^n-feryf-l 9{±, I/0-l'y^7i-;^2 1 Sr^n-LT 

[0022] ±f5(D«^(c*Dl^T. fx;^-:;!? / y 1 li^ 

^^agRSrfllfigi-SDMAl 4. 1 5 , ^^^-^ i/i/'a- 
^^y 1 6, n-;*/V7t^y 17, is, :/o-Irs'lM 
9, I/O-l'V^^i— y?.2 l4oJ;t;;^^y^^':?73i 

2 2 (1 1 ^5'y-e«fi£$ix5o 

[0023] ±i£ Lf:ilii^||;?(^^iIE*&agjHc i . 
fx^^Tt y 1 1 T'«^$tifc:®^{i^-ty^^^=^y 
M 2{cj:oT/^:^ 1 3 t^^y ;^ 2 2 40 

igSL^-rv^^y 2 3±(ciS^Ji:LT^tji4;h5„ 
:/p-fe5/f-i 9lt/^y;t^]) 2 3±lCfc5^'<^Sr/<>^ 
1 3^gSLT^^=¥^S'V'3. 1 6{cSit)ji^. ^^0) 

[0 0 2 4] 7°o-fes/f- 1 9l±;^^y;i<*y 2 3±(0X 
-^J'^^aa-rS^'^, -H.n-:^;yv^^y (A) 17* 
TtfiD-^yVT'^y (B) ISfCDMA (A) 14tfc 
{IDMA (B) 1 SSrffll/^Tfeis^U n-*;v-^-=ey 

(A) 1 7 4fc:{±o-;*;W^y (B) 184rT^-fe:;^ 
LXy'—^^mm-rio 50 
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[0 0 2 5] 7=-^&/^>'^^y 2 sicstttn-^-g- 

t,n-:^;;V;<^y (A) 1 7 4^l±n-*;l';<^ y 
(B) 1 8{C»ttflL-Cd^f>DMA (A) 14*fc:(iD 
MA (B) 1 5^^W)LXn~iJ;V/=e]) (A) 17* 
tciiu--:fyju/^D (B) 1 8(D\Hm^:!^'<y/'^D 2 
3(c*iii1-5»{cJ;oT^-rv^*y 2 3t#tii^<Sr 

[0 0 2 6] ROM2 4ttv->^-rA(757°n:/7A*Dj;t/« 

I/O-I'^'^^i— ;^2 1 Sr^fflLT-r^3^'2 5 ir-r 

6.(75A;'7*5<tt/7'n-irs/f-i 9 *^fe(om;^^ffiv^T^l: 

[0 0 2 7] -m^;^^ y:^"^') 2 ^(DB^M^Wimt. 

0- ^/u/^D 1 7, 1 axvikm^^Wc+iSmi'^ ^ 

fd, ^^^^^y 2 3f±SigcLfcTb*U^Sr/^-^bi: 

LXm^liiLtcj7-d^yyi^MzT^±:^-t^X'0^< © 
/^^- HW^t^ti-S., Z(0;i4y;^'eV(D^i±^±A^-f 
tcm:i^^ y/'t]) 2 3;^^?)— an— ;*yv^^y 1 7. 

1 8 {CDMA 1 4, 1 SSr^llfflLTtejSU ■r-tJ'HT 

[0 0 2 8] ri—ti^l^/'e}) (A) 1 7*iJ;U«n-:*/V 
^^y (B) 1 8{iV^i:>v^5^"y^Vv^^s/7T^: LT^ffi 

1- 5*;i5pitg-e$,5<, 0iJ;tfl, DMA (A) 14\ZX.<0 
;^^>'^^y 2 3/{i^PjO-*.'V7<^y (A) 17K^m 
cffCT'n-fe-yf-l 9{±D-:*/V7«^y (B) 1 8©F*1^ 
Sr^aU ot'tCDMA (B) 1 5{cJ;t9^^V;<^y 

2 3*=>bo-:*>'V'^*y (B) 1 Sfcteiif {cyn-fey 
f-1 9{in— */V7(^ y (A) 1 7©rt^^i{iai-5„ 
w©J;5J-> DMA<!:^a^:^-/<-7 2':^$-ti:'5*c 
J: !9 iSl^*!ia^**^#bti-5„ 

[0029] S^^ffilEttjJtWTyl'^y XA{C^j§oTtT*3 
[0 0 3 0] 
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fora=0;I<400;I-*+) 
{ 

fora=0;<640;j-H-) 
{ 

H=dlsjt[l][j] 

yy=dis_ya][J] 
lli«[l][J]=(dlstl[l][j]«input[yy][M] 
■mis 12 [i ] [ j] *input [yy] [xx+1] 
■Hllsl3[i] [i]*lnput [yy+1] [xx] 
■Hllst4[i][i]*iniiut[yy+l][xx+l]) jq 

*)!9.l|^MiE^C0®^;6MmgT'fc^„ $fe(Cdistl, dis 
t2. dist3, dist4{ifi^^>-T\ dist_x, dist_yttS;^^^M 

;V=?'!J X*A(Cjo^/^T. dist_x, dist_ytt;^^ yiaitJ'^ 
1 7*;/5:ttD-;<;7i'P<*y (B) 1 8{;iDMAeillLT 

UTtfiii/^L. n-;*7/v^^iJ ©§a;45/J^$^^i: tH2 

[00 3 1] j Srff:^[6](C0 7)^?)6 3 g^T-^-fb^itfc 
»-^©dist_x*3±tJ«dist_y©'(it{CJ: iJ TcW^input^ifj 30 

y^=^))<D^mt^m\'^(DX. j ;6^0;i^P)6 3 9* 
T?fE'f!i-r^raf-ifi^ttl$n-5 input© h^^tfi 5 
/j:DMA©^^^^fe**-C*i<„ M^fJ> (xx. yy) 
^5|2l2(Oj;5(C^^kLfc*g'. DMA^^7 5®ffl<!;LT 
tlia2©x;650;6»b6 3 9, yt^y li)>hy 2tit+^:i) 

< -t^bitMcii^ feJcDMA*tT5«5iaSrit 

[0 0 3 2] ^(Dx^icmmmcn^^^Lxmm^'if 40 

ofc^-a-. DMAiKjlliSr^T5{ctlliii©:^Dyi:^<ofcy£ 

tl5©T\ DMA©S/jNCr)1?-^X{ig^^oTI/^-5#;65^ 
t\ ia2©«^{Ctt (xx, yy) ©Wd^DMAcDft/MJ- 

XJCjifc/^ l/^^^iDMA<0:t/^■!^-r XSrJIffl 
fS^ir-rSo *fc. El2©Ja^{C{iDMAttl 1 
SlCJjCoTl^^o r(D^i:(DDMAgii^:/n-fe:yiM 
9;65-f^t^;t-r50-C{±:7'p-fe:?'lM 9 {c*ri-;5:fti^ 
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^itm^i£m3 (a) 0?I^S;Sr^^oT^^?.. rwff^S^T' 
^^yTKU';^tiSil^K;(^^'l'>^^y 2 3;6»^©gii 

* y T K U'^^tllsj^ife-efeS n -;!7;v^ * y (©PI$&T K 

y 7°<5';i5D-;(;;V^^y 1 7, 18±(dl^LT 

m^W.*^nx\,^x. ^ ^9 om^o^^jy y iT 
uc^^$tiTi/>5 ir-tor'^' y -/^TDMAIi 

[0 0 3 3] 1213 (b) (cfirtor^';^^ y -/^^ffli^ 
fc^JSr^LTI/^So MT'{i3oOKi^^«LT:*3>). 4 
-f. Tf-r^-^^y 2 3(^1 0 0 0»Jfi;}^f>2 0/M hSr 
P— ;!!7;V;^*y 1 7 4fcf±l 8 ©0#iS/5»b*t3A^. 
2fe{C/-t'>'p<^y 2 3691 2 4 0#lffe;j^f) 2 O/^-f hijr 
D-;<7>'M*y 1 7 4/cfll 8(D2 0»Jife;6» 
tf. ^'fy^^y 2 301 AAO^m^h&O 

^SrD-;<7;V;>t*y ©4 0#Jft;!l»b«tJi^T'i^7 
7 7^;55l/cC©T©T?*l-T-r^o BP*). [a2{C,T%$ti5 
J; 5 Jfcil^OT K ^^^©iH:^^;*^ a ^ ]) X\t y 

[0 0 3 4] c:©<t y 

/v^^y 1 7, 1 8±}cg#, «^tf-tf^©^a^- 
m(of-<:^^')-^^x-^i\,\t. T'D-fey-y-i 9ji-iHi© 

DMA©S1!|-^— ff^©input[xx] [yy] tC^ag-t-ST*- 

i>^n~^fV/=e^)\cn'oX<h^t^'^mtf£^. \.-t)^ 

^(D\t7'vJ±y->)-(Dm:h^-^Sti-^<DX\ "^I^T-C^ 
^ Vzf-if^i^^LX. ^-Yi^^^y 2 3{C*&«ftLT*3 
r^l^min-;^77V^^y 1 7, IBtCteiSLT^ 

-Sf'-i' y 7"^ fidesc[i] i: 1/^ 5 iE^UT-^ -f ^ y 
±Kmt^LXii<o 

[0 0 3 5] r©J;5f-LTD-*;v;^^yt:i 

^^otK DMA14, 15^m^^Xxi'-i}/V;^=^]} I 
7, \S\zm^^iMt.7''-i'\-m%\Z.J&mt£7'-'^ii*) 
#<e5ll$^^T^^5„ 4fc. input[yy][xx](CffiS-r5 

T—i'ifi^—^f^:^^^^) 17, 1 8±©t'©T K^;=^{c 

T>MAum^Mz.t^^i^^ti<x\±tiiht£\<\ zomn 

.address 5 IB^'Jt LT^-l'^^^y 2 3 
SsrttT*Jt. igi^^J'^BtJ-DMAfiGiii-CD-^^l'/^y 1 
7, 18tC^L, r©ffi*rffioTS53?SrfT5o LM_a 
ddressti 4o©S^Srjfo^jg#:-e, LM.address. W 
input [yy][xx]©D-;&;M*y 1 7, 1 8±©TKl^ 
^^ttL^ LM_address. 2/i5 input [yy] [xx+l]©D— 
/V;^^])!?, 1 8±©T Kw;^§rx L M_address. 
input[yy+l][xx]©n-;*/M*y 17,1 8±©T K 



I^^Sr> LM_address. 4;)5input[yy+l] [xx+1]CDp — ;<7 
±©T Kl^TiSr^LXI/^-S., /i4b\ input[yy] 
[xx]^ input [yy ] [xx+1]^ input[yy+l] [xx], input[yy+ 
1] [xx+l](il3— ;*/V;<^D {c:t5{t5 4occ> h Sr-ttL 

[003 6] ±faoDMAi!i^*Jii;«*n.a{iEI4 

tLTV^Sc IP*,, 04(C1*1-J; 5{c. t-f'7'n-iri/iM 
9 lidistU dist2, dist3, dist4Sr d — * U 

(A) 1 7tceii-rSJ; 5DMA^^^L. DMA^r>l 
i6i-5i:|^^{cn-;&yv^^!; (b) 1 8 OS^|S*!iaSr 

-e, ^!fc{C7°o^r->f-|idesc[i]S:P— ;i(7/i'p<^ll (A) 
1 rid^jl-r^ J; 5 DMA<^K:^U p— ;>&/i';^^]; 

(B) 1 8 ©?g3l*!!.atti^1-5o 
[0 0 3 7] ^(DDMAhmT-t^t. HTfiJ iZ.^^^ 

t^i)^^<D-Q^ -^StiinputCyyJLxx], input [yy+1] [xx], 
input [yy+1] [xx+1] , input [yy] [xx+1 ] <£:desc{rti§o T n 
-;«7;v^*y (A) {c^Eji1-5J;5»-DMASrBS?^U 
n-;&;W^^y (B) ©Sl^*[iati*|^-f ^„ i(DDM 
A;65|^T-r^ ifiJ !5 Ti^^m^t^^ . LM_addressSrn- 
(A) {Ctej^i-5ct5-fey h tTn-;!;;M 
*y (B) c7)Ma^^1-5o n-;i!7/p^^y (B) © 
^W)^Wi:>^ fc 6> LM_address©DMASEii:d5;^7 LT 
^'^^i^i^^i^mmu Mime. h 
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* (B) ;5»b^-r>^^y {C^tm-ripl-DMASrfT 
5. 

[0 0 3 8] gA±-e. o-:*yVpf^!J (A) IcDMAIg 

ilLTl^5rB^{cn-;*;V;>«^y (B) (cKE^^nfcrt^ 

(A) ^*!ia-f5J;5(-LTt/^:5„ 

[0 0 3 9] ei±T'IftP| Lfc^JfiMK±(7)^-tT^-« 

MA LTMai-5*t>^tgT'*5o 
[0 0 4 0] K-t±. ^»{Cle:>^/J^r-^^^o-;<7/M^ 

20 

[004 1] ^J6f^o-C*i< desctJit/LM.add 

ress. K L M_address. 2^ LM_address. 3^ LM_addre 

[0 04 2] 



[004 3] 



[0 0 4 4] 



for(i=0;i<400;i++) { 

LM_S T A R T = n — ;i!7/l/;^ * y (Ddesc^rAtl-T^J < ^S#lt6{C-fe j/ h 
for(j=0;<640;j++) { 
xx=dis_x[i] [j] 
yy=dis_y[i] [j] 

if (xx,yy;65desc[i]CDif>(c-^:ttL^i;i^o7tfc) { 

desc[i]{c:xx. yy<^-aif<t 5 ^^^^ y ^ Sr#MP;i^ 
LM_STARTS::/D5/^^:ftf£{t^>^ y 7<i^ h-rS} 
if (xx+l,yy;iMescti](Dft>}C'&*tl''j::a»oy5:b) { 

desc[i]{Cxx+l,yy^^tf i S/ Sr#(tAPX. 

LM_START^ynj/^':Sf£lt^'^i? y ^> h-tS) 
if (xx,yy+l;i5desc[i]©4'(C-^StL>'i^^o^cb) { 

desctilldxx.yy+lSr-^tf i y rJ' Sr#{tiPx.. 

LM_STARTSr7'o ^'ftfdtt-T >^ y ;^ >• hf^} 

if (xx+l,yy+l:d5desc[i]c7)if>(C-^^;}x/^:eiiofcfc) { 

desc[i](Cxx+l,yy+l^-^tf<t 5 ^^T'd y ^' ^#lj-j)P;t^ 

\.M_ST ART ^zfnv^^^Hn^y ^ }) :^yViri) 

desc[i];i)^bxx, yyCOo— y ©T K^^^Sr^fe 
LM_address. l[i] U]t-ti>, 

desc[i];i»t)XX+l,yy(Dn-iWt!)©7l>* wSr** 
LM_address. 2[i] [j] t-f^o 

desc[i] *^?3XX, yy+KDo — ^ y ©T K V' j)^ 
LM_address. 3[i] [j] t1r^o 



(7) 



11 



2 0 0 1 
12 



10 13 9 6 



[0 0 4 5] 



[0 0 4 6] 



desc[i]*^?3XX+l,yy+l(Dn— CD7 
L M_address. 4 [ i ] [ j] 1" 5 o 



} 



) 

[0 04 7] mc, ^(Dnmm-mommM^mmium 

[0 0 4 8] w©|l!B-efi, iBE^iDil^f^-^^'J!) 

* J: < ^a-r 5 fc ii) Wl^x - ^ to lEHI i: |p1 B$ (c: Ma ^ 

1 l^i^^^ixSi 5{>^2ocon— ;t;;U;^^U 1 7, 18/4^ 

ttlCli, te:^©^^!; 1 ScDF^^^ifea^n^ wlxir 20 
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